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ABSTRACT 

In this paper we introduce a new selection scheme in cellular 
genetic algorithms (cGAs). Anisotropic Selection (AS) pro- 
motes diversity and allows accurate control of the selective 
pressure. First we compare this new scheme with the classi- 
cal rectangular grid shapes solution according to the selec- 
tive pressure: we can obtain the same takeover time with the 
two techniques although the spreading of the best individual 
is different. We then give experimental results that show to 
what extent AS promotes the emergence of niches that sup- 
port low coupling and high cohesion. Finally, using a cGA 
with anisotropic selection on a Quadratic Assignment Prob- 
lem we show the existence of an anisotropic optimal value 
for which the best average performance is observed. Fur- 
ther work will focus on the selective pressure self-adjustment 
ability provided by this new selection scheme. 

Categories and Subject Descriptors 

1.2.8 [Problem Solving, Control Methods, and Search]: 

[Heuristic methods] 

General Terms 

Algorithms 

Keywords 

Evolutionary computation, combinatorial optimization 

Introduction 

This paper deals with selective pressure and diversity in 
cellular genetic algorithms (cGAs) which are a subclass of 
Genetic Algorithms where the population is embedded in 
a grid. These concepts are closely related to the explo- 
ration/exploitation trade-off. Previous studies on cGAs se- 
lected the size and the shape of neighborhoods [13], or the 
shape of the grid [2, 5, 6] as basic parameters to tune the 
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search process. Altering these structural parameters entails 
a deep change in the way we deal with the problem. For 
instance, there is no built-in mean to swap from a rectangu- 
lar grid to a square grid without misshaping the neighbor- 
hood relation. We suggest using anisotropic selection (AS) 
to promote diversity and to control accurately the selec- 
tive pressure in genetic search. The main advantage of the 
anisotropic selection scheme is that it allows to control the 
exploration/exploitation trade-off without affecting neither 
the grid topology nor the neighborhood shape; so the cellu- 
lar genetic algorithm we propose merely works on a square 
grid and a simple Von Neumann neighborhood shape. 
The paper is divided in 6 sections. Section [1] gives a brief 
definition of cGAs and an overview of existing techniques 
used to control the exploration/exploitation tradeoff. Sec- 
tion [2] introduces the AS scheme. Section [3] studies the in- 
fluence of AS on the selective pressure. In Section U we 
compare AS and rectangular grids topologies' influence on 
the selective pressure. In Section [S] we show how AS pro- 
motes the emergence of niches. In Section [6] we use a cGA 
on a Quadratic Assignment Problem to measure the cor- 
relation between anisotropy and performance. Finally we 
tie together the results of the previous sections and suggest 
directions for further research. 

1. SELECTION IN CELLULAR GENETIC 
ALGORITHMS 

This section presents a brief overview on cellular Genetic 
Algorithms and a standard technique to measure the selec- 
tive pressure. 

1.1 Cellular Genetic Algorithms 

Cellular Genetic Algorithms are a subclass of Genetic Al- 
gorithms (GAs) in which exploration and population diver- 
sity are enhanced thanks to the existence of small over- 
lapped neighborhoods [14]. Such algorithms are specially 
well suited for complex problems [9]. We assume a two- 
dimensional toroidal grid as a spatial population structure. 
Each grid cell contains one individual of the population. The 
overlapping neighborhoods provide an implicit mechanism 
for migration of genetic material throughout the grid. A 
genetic algorithm is assumed to be running simultaneously 
on each grid cell, continuously selecting parents from the 
neighborhood of that grid cell in order to produce an off- 
spring which replaces the current individual. 

1.2 Takeover Time 



A standard technique to study the induced selection pres- 
sure without introducing the perturbing effect of variation 
operators is to let selection be the only active operator, and 
then monitor the number of best individual copies N(t) in 
the population [8]. The takeover time is the time it takes 
for the single best individual to conquer the whole popula- 
tion. The grid is initialized with one cell having the best 
fitness and all the other having a null fitness. Since no other 
evolution mechanism but selection takes place, we can ob- 
serve the way the best individual spreads over the grid by 
counting generation after generation the number of copies 
of this one. A shorter takeover time thus means a higher se- 
lective pressure. It has been shown that when we move from 
a panmictic population, as in standard GA, to a spatially 
structured one of the same size with synchronous updat- 
ing of the cells, the global selection pressure induced on the 
entire population is weaker [13]. 

Links have been established between takeover time and 
neighborhood size and shape or grid topology. Neighbor- 
hood size and shape in a cGA are parameters that have 
some influence on the takeover time. A larger overlap of 
local neighborhoods of the same shape speeds up the best 
individual's spreading over the grid. The influence of the 
shape is given by Sarma and De Jong through a measure on 
the neighborhood which represents the spatial dispersion of 
a cell pattern [13] . Rather than the size of the neighborhood 
in terms of individuals, the key particularity of a local neigh- 
borhood is its radius. The takeover time decreases while the 
radius increases in a spatially structured population. 

We measure the relation between grid topology and selec- 
tive pressure for rectangular grids where the population size 
is fixed to 4096. We use the following grid shapes: 64 x 64; 
32 x 128; 16 x 256; 8 x 512; 4 x 1024 and 2 x 2048 indi- 
viduals. The selection strategy is a binary tournament. For 
each cell we randomly choose two individuals in its neighbor- 
hood. The best one then replaces the individual of the cell 
on the grid if it is fitter or with probability 0.5 if fitnesses are 
equal. Figure [T] shows the average of 10 3 independant runs 
of growth of N(t) against generations; the takeover time is 
reached when N(t) is equal to the size of the grid (see Table 
I). The average growth rate A(t), that is the number of new 
best individual copies per time unit, of these curves for four 
rectangular grid shapes (64 x 64, 32 x 128, 16 x 256,8 x 512) 
is plotted in Figure [2] This figure helps us to understand 
the growth of N(t). The growth rate A(t) is the same for all 
grids for the first generations. Then, the spreading speeds 
down to reach a constant speed for rectangular grids. This 
constant is 2lp where p is the probability of selecting the 
best individual when there is one copy of it in the neighbor- 
hood and I the shortest side of the grid [5] . More accurately, 
A(t) decreases when I is filled by copies of the best individ- 
ual (see Figure E^b)). Then, the speed becomes constant 
until the best individual has spread over to the other side 
(see Figure [3jc)). This explains why the 64 x 64 grid curve 
has no constant period: the two sides are filled at the same 
time. Finally, the growth rate falls down to zero as the best 
individual finishes conquering the grid. The results of the 
experiments we conducted are in agreement with E.Alba and 
J.Troya observations that narrow grid shapes induce low se- 
lective pressure [2]. We will see in the next sections that 
this behavior can be observed with the AS too. 
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Figure 1: Growth curves of the number of best in- 
dividual copies N(t) on different grid shapes. 
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Figure 2: Growth rate against time steps for four 
rectangular grid shapes. 
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Figure 3: Spreading of the best individual over a 
32x128 grid 
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Figure 4: Von Neumann and Von Neumann fuzzy 
Neighborhoods with probabilities to choose each 
neighbor 



Table 1: Takeover time for different rectangular grid 
shapes. 
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2. ANISOTROPIC SELECTION 

This section introduces our contribution: the Anisotropic 
Selection method where the neighbors of a cell may be se- 
lected with different probabilities. 

2.1 Von Neumann Fuzzy Neighborhood 

The Von Neumann neighborhood of a cell C is defined as 
the ball of radius 1 in Manhattan distance centered at C. 
Using the Von Neumann Fuzzy Neighborhood, we assign dif- 
ferent probabilities to choose one cell in the neighborhood 



p c to choose the center cell C is set at g as for Von Neumann 
neighborhood. Let p n3 denote the probability to choose the 
cell N or S and p ew denote the probability to choose the 
cell E or W . Let a £ [—1; 1] be the control parameter, the 
anisotropy degree. When a = — 1, we have p em — 1 — p c and 
Pns = 0, when a = 0we have p ns = p ew and when a = 1 we 
have Pns — 1 — Pc and p ew = 0. Thus, the probabilities p n3 
and pew ca,n be described as: 



p„ s = ^-^(l + a) 



The case a = correspond to the standard Von Neumann 
neighborhood (p ns — p ew — |) and a = 1 is the limiting 
case for fuzzy neighborhood where p ns = | and p ew = 0. In 
the latter case, there is a vertical neighborhood with three 
neighbors onl)[_j. 

2.2 Definition 

The AS operator exploits the Von Neumann Fuzzy Neigh- 
borhood. It works as follows: for each cell k individuals are 
selected accordingly to the probabilities p n3 , p ew and p c (k 
stands in the range [1,5]) within the cell neighborhood. The 
k individuals participate to a tournament and the winner re- 
places the old individual if it is fitter or with probability 0.5 
if fitnesses are equal. The control parameter a is a measure 
of anisotropy: a — corresponds to standard selection, and 
a = 1 is the limiting case with the utmost anisotropy. We 
conjecture that selective pressure decreases when anisotropy 
increases. 

3. SELECTIVE PRESSURE AND 
ANISOTROPIC SELECTION 

In this section we study the relationship between selective 
pressure and AS. First, we measure the takeover time for 
different anisotropy degrees, then we take the study further 
by considering the growth curve of the best individual. 

We measure the effect of different anisotropy degrees on 
the takeover time. In our experiments, the anisotropic se- 
lection is based on tournament selection of size k — 2 on 
the square grid of side 64. All the 4096 cells are updated 
synchronously. For each cell, we substitute the selected in- 
dividual to the one already present in that cell, either sys- 
tematically if the selected individual is fitter, or with prob- 
ability 0.5 if fitnesses are equal. For each value of a, we 
perform 10 3 independent runs. When a = 0, no direction 
is privileged and AS is equivalent to the standard selection 
method. When a = 1, only one direction is exploited, the 
grid can not be filled and the takeover time is not defined. 
Figure [5] shows the influence of AS on the takeover time : 
it increases with the parameter a. These results are fairly 
consistent with our expectation that selection intensity de- 
creases when the anisotropic degree increases. However, the 
correlation between takeover and anisotropy is not linear; it 
rapidly increases after the value a — 0.9. 
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Table 2: Values of a and i for the same takeover 
time. Linear regression shows the relation between 
a and £ by the equation a=-0.999-^+0.998 with high 
correlation coefficient —0.9999 
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Figure 5: Average of the takeover time as a function 
of the anisotropic degree a. 
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Figure 6: Growth curves of N(t) (a) and A(t) (b) on 
a square grid for different anisotropic degrees a. 



Figure [6] shows the average curves of the growth of best 



individual (a) and its growth rate (b) as a function of time 
steps. The shape of the curve is decomposed into three 
stages: in the first stage, the growth rate is almost propor- 
tional to the time steps and the growth curve is approxima- 
tively a parabola. In the second stage, this rate becomes 
roughly constant after a period of decrease and the growth 
curve is almost linear. In the last stage, the rate decreases 
linearly down to zero with a different slope than in the first 
stage. The higher the anisotropic degree a, the weaker the 
initial slope of the growth rate. In the same way in the 
second stage, the slope of growth curve is smaller when a 
is higher. Therefore, the selective pressure is lower when 
anisotropy is higher. 

The three stages of the growth curve correspond to three 
periods in the spreading of the best individual on the square 
grid (see Figure [7]). During the first stage, the best individ- 
ual spreads more in the privileged direction. This period 
finishes, as described in Section Tl. 2 1 when a side of the grid 
is filled by best individual copies in the privileged direction 
(see Figure [7jb)). During the second period, the best indi- 
vidual fills the second direction of the grid until it has spread 
over a side of it in the less privileged direction (see Figure 
Efc)). The best individual front is sharp at the beginning, 
and becomes approximatively a horizontal line later. The 
third time finishes to fill the grid. Taking into account these 
three phases, one may be able to give the equation of the 
growth curve as in [5]. 

4. ANISOTROPIC SELECTION VS. 
RECTANGULAR GRID 

Changing rectangular grid shape and tuning the anisotro- 
pic degree are two methods for varying the selective pressure. 
This section compares the two methods and shows in which 
way they are equivalent. 

From the experimental results presented in Sections I1.2I 
and OH we compute the a parameter value for which we ob- 
tained the same takeover time as for one particular rectan- 
gular grid shape. In Table II we give the a andj- values and 
exhibit the correlation between these parameters. We can 
see that a is proportional to the j- ratio. So, according to 
the takeover time using a — 1 — -j-, it is possible to have the 
same selective pressure using the two methods. 

Figure [8] shows the mean growth curves of the best indi- 
vidual spreading against time steps for all grid shapes and 
for the corresponding square grids using AS. Although, us- 
ing the relation a — 1 — jr, we found the same takeover 
time with rectangular grid shapes and with AS the selective 
pressure is applied in a different way for the two methods. 




Figure 7: Spreading of the best individual with 
a=0.75 



It is weaker during the first generations in the anisotropic 
case then it becomes slightly stronger, to finally fill the grid 
at the same takeover time. 

5. ANISOTROPIC SELECTION AND 
NICHING 

Many real optimization problems require the coexistence 
of diverse solutions during the search. In this section we 
show how the anisotropic selection is able to promote nich- 
ing. 

5.1 Niching methods 

Niching methods have been proposed in the field of genetic 
algorithms to preserve population diversity and to allow the 
GA to investigate many peaks in parallel. As a side effect, 
niching prevents the GA from being trapped in local optima. 
Niching methods are inspired from nature where species spe- 
cialize themselves to different ecological niches in order to 
decrease the selective pressure they undergo. Niching GA's 
tend to achieve a natural emergence of niches in the search 
space. A niche is commonly referred to as an optimum of 
the domain, the fitness representing the resources of that 
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Figure 8: Comparison between growth curves on 
different rectangular grids and on a square grid with 
the equivalent anisotropy degree. 

niche [12]. Niching methods are used to solve multimodal 
problems, and also in dynamic optimization [4]. For such 
problems a GA must maintain a diverse population that can 
adapt to the changing landscape and locate better solutions 
dynamically. There are different niching GA for panmic- 
tic population: sharing, crowding, etc. These methods are 
based on the concept of distance: sharing [7] decreases the 
fitness according to the number of similar individuals in the 
population, and with crowding, replacement is performed 
considering the distance between solutions. 

5.2 Experimental results 

To show up to what extent anisotropic selection promotes 
niching, we have conducted experiments where two solu- 
tions with the best fitness (here 1) are placed on a 64 x 64 
square grid at the initial generation. These solutions are 
farther from each other in the least favored direction (here 
oriented horizontally). Figure Hx2l shows some snapshots of 
the spreading of the two bests over generations for different 
anisotropic degrees. Cells in light grey (resp. dark grey) are 
copies of the first best (resp. the second best), and all white 
cells have a null fitness value. Generations grow from top 
to bottom, and the anisotropic parameter a increases from 
left to right. The left-hand row (a = 0) represents standard 
binary tournament schema ; we observe that standard selec- 
tion is not able to maintain niches, after 1000 generations 
the grid is a mixture of the two optima. On the other hand, 
as a increases, two stable frontiers between niches emerge. 
Hence AS increases cohesion in each cells lineages. 
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Figure 9: Spreading of two copies of the best individual 



6. TEST PROBLEM 

We experiment a cGA using anisotropic selection on a 
Quadratic Assignment Problem (QAP): Nug30. Our aim 
here is not to obtain better results with respect to other 
optimization methods, but rather to observe the behavior 
of a cGA with AS. In particular, we seek an optimal value 
for the anisotropy degree. 

6.1 The Quadratic Assigment Problem 

The QAP is an important problem in both theory and 
practice. It was introduced by Koopmans and Beckmann in 
1957 and is a modal for many practical problems [10]. 
The QAP can be described as the problem of assigning a 
set of facilities to a set of locations with given distances be- 
tween the locations and given flows between the facilities. 
The goal is to place the facilities on locations in such a way 
that the sum of the products between flows and distances is 
minimal. 

Given n facilities and n locations, two n x n matrices D — 
[du] and F = [/„■] where du is the distance between loca- 
tions k and I and fij the flow between facilities i and j, the 
objective function is: 

* = / ]/ ) dp(i)p<J)fii 
i 3 

where p(i) gives the location of facility i in the current per- 
mutation p. 

Nugent, Vollman and Ruml suggested a set of problem in- 
stances of different sizes noted for their difficulty [3]. The 
instances they suggested are known to have multiple local 
optima, so they are difficult for a genetic algortihm. We ex- 
periment our algorithm on their 30 variables instance called 
Nug30. 

6.2 Experiments 

We consider a population of 400 individuals placed on a 
square grid. Each individual represents a permutation of 
{1, 2, 30}. We need a special crossover that preserves the 
permutations: 

• Select two individuals p\ and p2 as genitors. 

• Choose a random position i. 

• Find j and k so that pi(i) = P2U) and P2(i) = Pi(k). 

• swap positions i and j from p\ and positions i and k 
from p2- 

• repeat n/3 times this procedure where n is the length 
of an individual. 

This crossover is an extended version of the UPMX crossover 
proposed in [11]. The mutation operator consists in ran- 
domly selecting two positions from the individual and ex- 
changing these positions. The crossover rate is 1 and we 
perform one mutation per individual in average. 
We consider 500 runs for each anisotropy degree. Each run 
stops after 1500 generations. 

Figure [10] shows the average performance of the algorithm 
towards a: for each value of a we average the best solution 
of each run. Performances are growing with a and then fall 
down as a is getting closer to its limit value. This curve 
shows the influence of the selective pressure on the perfor- 
mances and how important it is to control it accurately. 



The best average performance is observed for a — 0.86, 
which corresponds to a good exploration/exploitation trade- 
off. In the neighborhood of this optimal value the algorithm 
favors propagation of good solutions in the vertical direction 
with few interactions on the left or right sides. This kind 
of dynamics is well adapted to multi-modal problems as we 
can reach local optima on each columns of the grid and then 
migrate them horizontally to find new solutions. 

Performances would probably improve if the selective pres- 
sure did not remain static during the search process. As in 
[1], we can define some criteria to self-adjust the anisotropy 
degree along generations. Furthermore, we can assign a dif- 
ferent anisotropy degree to each cell of the grid, so that we 
can determinate criteria to self-adjust selective pressure lo- 
cally upon measures on neighborhoods. 
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Figure 10: Average costs as a function of a. 

Conclusions and Perspectives 

This paper presents a new selection scheme in cellular ge- 
netic algorithms. The main objective is to control the ex- 
ploration/exploitation tradeoff in a flexible way. We pro- 
pose to exploit the cellular GA characteristics to promote 
diversity during a genetic search process. Previous studies 
on cGAs selected structural parameters, as neighborhood 
or grid shape, to tune the selective pressure. The main 
drawback of these techniques is that altering a structural 
parameter entails a deep change in the way we deal with 
the problem. The new selection scheme we suggest is based 
on fuzzy neighborhood where a cell is chosen according to 
different probabilities. In order to favor one direction rather 
than the other one, anisotropic selection chooses individu- 
als in fuzzy neighborhood. Experiments performed in order 
to establish relation between the takeover time and the de- 
gree of anisotropy are consistent with our expectation that 
selection pressure decreases with the degree of anisotropy. 
Analysis of the growth curves allows to distinguish three 
different phases in the diffusion process. Experimental re- 
sults establish linear correlation in takeover between AS and 
cGA using rectangular grid. Then we point out capabilities 
of AS to promote the emergence of niches. Finally, using 
a cGA with AS on a QAP we have shown the existence of 
an anisotropic optimal value of a such that the best average 
performance is observed. 



This paper is a preliminary investigation and a more ex- 
tensive analysis must be made to confirm that equilibrium 
between exploration and exploitation makes AS a good tech- 
nique for complex problems in static or dynamic environ- 
ments. Future work should address the following issues: 
comparison between AS and changes in the neighborhood 
shape and size, measuring AS effects with cGA using mu- 
tation and crossover, change the balance of directions dy- 
namically. The latter point is an important feature: by tun- 
ing the control parameter a, it would be possible to make 
the algorithm to self-adjust the selective pressure, depend- 
ing on global or local measures. This adaptive ability has 
two important advantages: first, parameter a may vary in 
a continuous way, second, variations of this parameter have 
affect neither on the grid topology nor on the neighborhood 
shape. Such self-adaptive algorithms have been studied in 
previous works, but they need to change the grid topology 
to control the selective pressure [1] , which means it is uni- 
form in the grid. AS allows different propagation speeds on 
each area of the grid, promoting diversification and intensi- 
fication (exploitation) at the same time on different spots. 
In general, we have to continue investigation of Anisotropic 
Selection to assess its validity and generality. 
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